Specify the tissue of interest, run the boilerplate code which sets up the functions and environment, load the tissue object.

tissue_of_interest = "Tongue"
library(here)
source(here("00_data_ingest", "02_tissue_analysis_rmd", "boilerplate.R"))
Loading required package: ggplot2
Loading required package: cowplot

Attaching package: ‘cowplot’

The following object is masked from ‘package:ggplot2’:

    ggsave

Loading required package: Matrix

Attaching package: ‘dplyr’

The following object is masked from ‘package:Biobase’:

    combine

The following objects are masked from ‘package:BiocGenerics’:

    combine, intersect, setdiff, union

The following objects are masked from ‘package:stats’:

    filter, lag

The following objects are masked from ‘package:base’:

    intersect, setdiff, setequal, union
tiss = load_tissue_facs(tissue_of_interest)
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Scaling data matrix"

  |                                                                                                          
  |                                                                                                    |   0%
  |                                                                                                          
  |====================================================================================================| 100%
Calculating gene means
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating gene variance to mean ratios
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|

Visualize top genes in principal components

Later on (in FindClusters and TSNE) you will pick a number of principal components to use. This has the effect of keeping the major directions of variation in the data and, ideally, supressing noise. There is no correct answer to the number to use, but a decent rule of thumb is to go until the plot plateaus.

PCElbowPlot(object = tiss)

Choose the number of principal components to use.

# Set number of principal components. 
n.pcs = 10

The clustering is performed based on a nearest neighbors graph. Cells that have similar expression will be joined together. The Louvain algorithm looks for groups of cells with high modularity–more connections within the group than between groups. The resolution parameter determines the scale…higher resolution will give more clusters, lower resolution will give fewer.

For the top-level clustering, aim to under-cluster instead of over-cluster. It will be easy to subset groups and further analyze them below.

# Set resolution 
res.used <- 0.7
tiss <- FindClusters(object = tiss, reduction.type = "pca", dims.use = 1:n.pcs, 
    resolution = res.used, print.output = 0, save.SNN = TRUE, force.recalc = TRUE)

To visualize

# If cells are too spread out, you can raise the perplexity. If you have few cells, try a lower perplexity (but never less than 10).
tiss <- RunTSNE(object = tiss, dims.use = 1:n.pcs, seed.use = 20, perplexity=30)
# note that you can set do.label=T to help label individual clusters
TSNEPlot(object = tiss, do.label = T, pt.size = 1.2, label.size = 4)

Check expression of genes of interset.

Dotplots let you see the intensity of exppression and the fraction of cells expressing for each of your genes of interest.

How big are the clusters?

table(tiss@ident)

  0   1   2   3   4   5   6   7 
368 253 196 182 161 121 108  27 
tiss1=BuildClusterTree(tiss)
[1] "Finished averaging RNA for cluster 0"
[1] "Finished averaging RNA for cluster 1"
[1] "Finished averaging RNA for cluster 2"
[1] "Finished averaging RNA for cluster 3"
[1] "Finished averaging RNA for cluster 4"
[1] "Finished averaging RNA for cluster 5"
[1] "Finished averaging RNA for cluster 6"
[1] "Finished averaging RNA for cluster 7"

Which markers identify a specific cluster?

#cluster1.markers <- FindMarkers(object = tiss, ident.1 = 1, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
#cluster2.markers <- FindMarkers(object = tiss, ident.1 = 2, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
#cluster3.markers <- FindMarkers(object = tiss, ident.1 = 3, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
#cluster4.markers <- FindMarkers(object = tiss, ident.1 = 4, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
#cluster5.markers <- FindMarkers(object = tiss, ident.1 = 5, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
#cluster6.markers <- FindMarkers(object = tiss, ident.1 = 6, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
cluster7.markers <- FindMarkers(object = tiss, ident.1 = 6, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
#cluster0.markers <- FindMarkers(object = tiss, ident.1 = 0, min.pct = 0.25, only.pos = TRUE, thresh.use = 0.25)
print(x = head(x = cluster6.markers, n = 30))

You can also compute all markers for all clusters at once. This may take some time.

tiss.markers <- FindAllMarkers(object = tiss, only.pos = TRUE, min.pct = 0.25, thresh.use = 0.25)

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~01m 34s      
   |++                                                | 2 % ~01m 31s      
   |++                                                | 3 % ~01m 29s      
   |+++                                               | 4 % ~01m 28s      
   |+++                                               | 5 % ~01m 26s      
   |++++                                              | 6 % ~01m 25s      
   |++++                                              | 7 % ~01m 25s      
   |+++++                                             | 8 % ~01m 24s      
   |+++++                                             | 9 % ~01m 27s      
   |++++++                                            | 10% ~01m 26s      
   |++++++                                            | 11% ~01m 25s      
   |+++++++                                           | 12% ~01m 23s      
   |+++++++                                           | 13% ~01m 22s      
   |++++++++                                          | 14% ~01m 21s      
   |++++++++                                          | 15% ~01m 19s      
   |+++++++++                                         | 16% ~01m 18s      
   |+++++++++                                         | 17% ~01m 17s      
   |++++++++++                                        | 18% ~01m 16s      
   |++++++++++                                        | 19% ~01m 15s      
   |+++++++++++                                       | 20% ~01m 14s      
   |+++++++++++                                       | 21% ~01m 13s      
   |++++++++++++                                      | 22% ~01m 12s      
   |++++++++++++                                      | 23% ~01m 11s      
   |+++++++++++++                                     | 24% ~01m 10s      
   |+++++++++++++                                     | 26% ~01m 09s      
   |++++++++++++++                                    | 27% ~01m 08s      
   |++++++++++++++                                    | 28% ~01m 07s      
   |+++++++++++++++                                   | 29% ~01m 06s      
   |+++++++++++++++                                   | 30% ~01m 05s      
   |++++++++++++++++                                  | 31% ~01m 05s      
   |++++++++++++++++                                  | 32% ~01m 04s      
   |+++++++++++++++++                                 | 33% ~01m 03s      
   |+++++++++++++++++                                 | 34% ~01m 02s      
   |++++++++++++++++++                                | 35% ~01m 01s      
   |++++++++++++++++++                                | 36% ~60s          
   |+++++++++++++++++++                               | 37% ~59s          
   |+++++++++++++++++++                               | 38% ~58s          
   |++++++++++++++++++++                              | 39% ~57s          
   |++++++++++++++++++++                              | 40% ~56s          
   |+++++++++++++++++++++                             | 41% ~55s          
   |+++++++++++++++++++++                             | 42% ~54s          
   |++++++++++++++++++++++                            | 43% ~53s          
   |++++++++++++++++++++++                            | 44% ~52s          
   |+++++++++++++++++++++++                           | 45% ~51s          
   |+++++++++++++++++++++++                           | 46% ~50s          
   |++++++++++++++++++++++++                          | 47% ~49s          
   |++++++++++++++++++++++++                          | 48% ~48s          
   |+++++++++++++++++++++++++                         | 49% ~47s          
   |+++++++++++++++++++++++++                         | 50% ~46s          
   |++++++++++++++++++++++++++                        | 51% ~45s          
   |+++++++++++++++++++++++++++                       | 52% ~44s          
   |+++++++++++++++++++++++++++                       | 53% ~43s          
   |++++++++++++++++++++++++++++                      | 54% ~42s          
   |++++++++++++++++++++++++++++                      | 55% ~42s          
   |+++++++++++++++++++++++++++++                     | 56% ~41s          
   |+++++++++++++++++++++++++++++                     | 57% ~40s          
   |++++++++++++++++++++++++++++++                    | 58% ~39s          
   |++++++++++++++++++++++++++++++                    | 59% ~38s          
   |+++++++++++++++++++++++++++++++                   | 60% ~37s          
   |+++++++++++++++++++++++++++++++                   | 61% ~36s          
   |++++++++++++++++++++++++++++++++                  | 62% ~35s          
   |++++++++++++++++++++++++++++++++                  | 63% ~34s          
   |+++++++++++++++++++++++++++++++++                 | 64% ~33s          
   |+++++++++++++++++++++++++++++++++                 | 65% ~32s          
   |++++++++++++++++++++++++++++++++++                | 66% ~31s          
   |++++++++++++++++++++++++++++++++++                | 67% ~30s          
   |+++++++++++++++++++++++++++++++++++               | 68% ~29s          
   |+++++++++++++++++++++++++++++++++++               | 69% ~28s          
   |++++++++++++++++++++++++++++++++++++              | 70% ~27s          
   |++++++++++++++++++++++++++++++++++++              | 71% ~26s          
   |+++++++++++++++++++++++++++++++++++++             | 72% ~25s          
   |+++++++++++++++++++++++++++++++++++++             | 73% ~24s          
   |++++++++++++++++++++++++++++++++++++++            | 74% ~23s          
   |++++++++++++++++++++++++++++++++++++++            | 76% ~23s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~22s          
   |+++++++++++++++++++++++++++++++++++++++           | 78% ~21s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~20s          
   |++++++++++++++++++++++++++++++++++++++++          | 80% ~19s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~18s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~17s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~16s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~15s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~14s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~13s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~12s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~11s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~10s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 90% ~09s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~08s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 92% ~08s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~07s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~06s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~05s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~04s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~03s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~02s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~01s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 01m 32s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~01m 53s      
   |++                                                | 2 % ~02m 18s      
   |++                                                | 3 % ~02m 17s      
   |+++                                               | 4 % ~02m 08s      
   |+++                                               | 5 % ~02m 03s      
   |++++                                              | 6 % ~01m 59s      
   |++++                                              | 7 % ~01m 55s      
   |+++++                                             | 8 % ~01m 53s      
   |+++++                                             | 9 % ~01m 50s      
   |++++++                                            | 10% ~01m 48s      
   |++++++                                            | 11% ~01m 47s      
   |+++++++                                           | 12% ~01m 46s      
   |+++++++                                           | 13% ~01m 44s      
   |++++++++                                          | 14% ~01m 42s      
   |++++++++                                          | 15% ~01m 41s      
   |+++++++++                                         | 16% ~01m 39s      
   |+++++++++                                         | 17% ~01m 38s      
   |++++++++++                                        | 18% ~01m 37s      
   |++++++++++                                        | 19% ~01m 35s      
   |+++++++++++                                       | 20% ~01m 34s      
   |+++++++++++                                       | 21% ~01m 33s      
   |++++++++++++                                      | 22% ~01m 31s      
   |++++++++++++                                      | 23% ~01m 31s      
   |+++++++++++++                                     | 24% ~01m 32s      
   |+++++++++++++                                     | 26% ~01m 30s      
   |++++++++++++++                                    | 27% ~01m 29s      
   |++++++++++++++                                    | 28% ~01m 27s      
   |+++++++++++++++                                   | 29% ~01m 26s      
   |+++++++++++++++                                   | 30% ~01m 25s      
   |++++++++++++++++                                  | 31% ~01m 23s      
   |++++++++++++++++                                  | 32% ~01m 22s      
   |+++++++++++++++++                                 | 33% ~01m 21s      
   |+++++++++++++++++                                 | 34% ~01m 19s      
   |++++++++++++++++++                                | 35% ~01m 18s      
   |++++++++++++++++++                                | 36% ~01m 16s      
   |+++++++++++++++++++                               | 37% ~01m 15s      
   |+++++++++++++++++++                               | 38% ~01m 14s      
   |++++++++++++++++++++                              | 39% ~01m 13s      
   |++++++++++++++++++++                              | 40% ~01m 11s      
   |+++++++++++++++++++++                             | 41% ~01m 10s      
   |+++++++++++++++++++++                             | 42% ~01m 09s      
   |++++++++++++++++++++++                            | 43% ~01m 08s      
   |++++++++++++++++++++++                            | 44% ~01m 06s      
   |+++++++++++++++++++++++                           | 45% ~01m 05s      
   |+++++++++++++++++++++++                           | 46% ~01m 04s      
   |++++++++++++++++++++++++                          | 47% ~01m 03s      
   |++++++++++++++++++++++++                          | 48% ~01m 01s      
   |+++++++++++++++++++++++++                         | 49% ~01m 00s      
   |+++++++++++++++++++++++++                         | 50% ~59s          
   |++++++++++++++++++++++++++                        | 51% ~57s          
   |+++++++++++++++++++++++++++                       | 52% ~56s          
   |+++++++++++++++++++++++++++                       | 53% ~55s          
   |++++++++++++++++++++++++++++                      | 54% ~54s          
   |++++++++++++++++++++++++++++                      | 55% ~53s          
   |+++++++++++++++++++++++++++++                     | 56% ~51s          
   |+++++++++++++++++++++++++++++                     | 57% ~50s          
   |++++++++++++++++++++++++++++++                    | 58% ~49s          
   |++++++++++++++++++++++++++++++                    | 59% ~48s          
   |+++++++++++++++++++++++++++++++                   | 60% ~47s          
   |+++++++++++++++++++++++++++++++                   | 61% ~45s          
   |++++++++++++++++++++++++++++++++                  | 62% ~44s          
   |++++++++++++++++++++++++++++++++                  | 63% ~43s          
   |+++++++++++++++++++++++++++++++++                 | 64% ~42s          
   |+++++++++++++++++++++++++++++++++                 | 65% ~40s          
   |++++++++++++++++++++++++++++++++++                | 66% ~39s          
   |++++++++++++++++++++++++++++++++++                | 67% ~38s          
   |+++++++++++++++++++++++++++++++++++               | 68% ~37s          
   |+++++++++++++++++++++++++++++++++++               | 69% ~36s          
   |++++++++++++++++++++++++++++++++++++              | 70% ~34s          
   |++++++++++++++++++++++++++++++++++++              | 71% ~33s          
   |+++++++++++++++++++++++++++++++++++++             | 72% ~32s          
   |+++++++++++++++++++++++++++++++++++++             | 73% ~31s          
   |++++++++++++++++++++++++++++++++++++++            | 74% ~30s          
   |++++++++++++++++++++++++++++++++++++++            | 76% ~29s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~27s          
   |+++++++++++++++++++++++++++++++++++++++           | 78% ~26s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~25s          
   |++++++++++++++++++++++++++++++++++++++++          | 80% ~24s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~23s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~21s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~20s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~19s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~18s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~17s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~15s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~14s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~13s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 90% ~12s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~11s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 92% ~10s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~08s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~07s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~06s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~05s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~04s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~02s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~01s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 01m 56s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~02m 51s      
   |++                                                | 2 % ~02m 53s      
   |++                                                | 3 % ~02m 52s      
   |+++                                               | 4 % ~02m 47s      
   |+++                                               | 5 % ~02m 44s      
   |++++                                              | 6 % ~02m 41s      
   |++++                                              | 7 % ~02m 39s      
   |+++++                                             | 8 % ~02m 37s      
   |+++++                                             | 9 % ~02m 35s      
   |++++++                                            | 10% ~02m 34s      
   |++++++                                            | 11% ~02m 33s      
   |+++++++                                           | 12% ~02m 30s      
   |+++++++                                           | 13% ~02m 28s      
   |++++++++                                          | 14% ~02m 26s      
   |++++++++                                          | 15% ~02m 25s      
   |+++++++++                                         | 16% ~02m 23s      
   |+++++++++                                         | 17% ~02m 21s      
   |++++++++++                                        | 18% ~02m 20s      
   |++++++++++                                        | 19% ~02m 18s      
   |+++++++++++                                       | 20% ~02m 16s      
   |+++++++++++                                       | 21% ~02m 14s      
   |++++++++++++                                      | 22% ~02m 13s      
   |++++++++++++                                      | 23% ~02m 11s      
   |+++++++++++++                                     | 24% ~02m 09s      
   |+++++++++++++                                     | 25% ~02m 07s      
   |++++++++++++++                                    | 26% ~02m 05s      
   |++++++++++++++                                    | 27% ~02m 03s      
   |+++++++++++++++                                   | 28% ~02m 04s      
   |+++++++++++++++                                   | 29% ~02m 02s      
   |++++++++++++++++                                  | 30% ~01m 60s      
   |++++++++++++++++                                  | 31% ~01m 58s      
   |+++++++++++++++++                                 | 32% ~01m 56s      
   |+++++++++++++++++                                 | 33% ~01m 55s      
   |++++++++++++++++++                                | 34% ~01m 53s      
   |++++++++++++++++++                                | 35% ~01m 51s      
   |+++++++++++++++++++                               | 36% ~01m 49s      
   |+++++++++++++++++++                               | 37% ~01m 48s      
   |++++++++++++++++++++                              | 38% ~01m 46s      
   |++++++++++++++++++++                              | 39% ~01m 44s      
   |+++++++++++++++++++++                             | 40% ~01m 42s      
   |+++++++++++++++++++++                             | 41% ~01m 41s      
   |++++++++++++++++++++++                            | 42% ~01m 39s      
   |++++++++++++++++++++++                            | 43% ~01m 37s      
   |+++++++++++++++++++++++                           | 44% ~01m 36s      
   |+++++++++++++++++++++++                           | 45% ~01m 34s      
   |++++++++++++++++++++++++                          | 46% ~01m 32s      
   |++++++++++++++++++++++++                          | 47% ~01m 30s      
   |+++++++++++++++++++++++++                         | 48% ~01m 29s      
   |+++++++++++++++++++++++++                         | 49% ~01m 27s      
   |++++++++++++++++++++++++++                        | 51% ~01m 25s      
   |++++++++++++++++++++++++++                        | 52% ~01m 23s      
   |+++++++++++++++++++++++++++                       | 53% ~01m 22s      
   |+++++++++++++++++++++++++++                       | 54% ~01m 20s      
   |++++++++++++++++++++++++++++                      | 55% ~01m 18s      
   |++++++++++++++++++++++++++++                      | 56% ~01m 16s      
   |+++++++++++++++++++++++++++++                     | 57% ~01m 15s      
   |+++++++++++++++++++++++++++++                     | 58% ~01m 13s      
   |++++++++++++++++++++++++++++++                    | 59% ~01m 11s      
   |++++++++++++++++++++++++++++++                    | 60% ~01m 09s      
   |+++++++++++++++++++++++++++++++                   | 61% ~01m 08s      
   |+++++++++++++++++++++++++++++++                   | 62% ~01m 06s      
   |++++++++++++++++++++++++++++++++                  | 63% ~01m 04s      
   |++++++++++++++++++++++++++++++++                  | 64% ~01m 02s      
   |+++++++++++++++++++++++++++++++++                 | 65% ~01m 01s      
   |+++++++++++++++++++++++++++++++++                 | 66% ~59s          
   |++++++++++++++++++++++++++++++++++                | 67% ~57s          
   |++++++++++++++++++++++++++++++++++                | 68% ~56s          
   |+++++++++++++++++++++++++++++++++++               | 69% ~54s          
   |+++++++++++++++++++++++++++++++++++               | 70% ~52s          
   |++++++++++++++++++++++++++++++++++++              | 71% ~50s          
   |++++++++++++++++++++++++++++++++++++              | 72% ~49s          
   |+++++++++++++++++++++++++++++++++++++             | 73% ~47s          
   |+++++++++++++++++++++++++++++++++++++             | 74% ~45s          
   |++++++++++++++++++++++++++++++++++++++            | 75% ~43s          
   |++++++++++++++++++++++++++++++++++++++            | 76% ~42s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~40s          
   |+++++++++++++++++++++++++++++++++++++++           | 78% ~38s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~36s          
   |++++++++++++++++++++++++++++++++++++++++          | 80% ~35s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~33s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~31s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~30s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~28s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~26s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~24s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~23s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~21s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~19s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 90% ~18s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~16s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 92% ~14s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~12s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~11s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~09s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~07s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~05s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~04s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~02s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 02m 52s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~02m 23s      
   |+                                                 | 2 % ~02m 19s      
   |++                                                | 3 % ~02m 19s      
   |++                                                | 4 % ~02m 17s      
   |+++                                               | 5 % ~02m 18s      
   |+++                                               | 6 % ~02m 20s      
   |++++                                              | 7 % ~02m 20s      
   |++++                                              | 8 % ~02m 17s      
   |+++++                                             | 9 % ~02m 15s      
   |+++++                                             | 10% ~02m 15s      
   |++++++                                            | 11% ~02m 13s      
   |++++++                                            | 12% ~02m 14s      
   |+++++++                                           | 13% ~02m 11s      
   |+++++++                                           | 14% ~02m 12s      
   |++++++++                                          | 15% ~02m 10s      
   |++++++++                                          | 16% ~02m 08s      
   |+++++++++                                         | 17% ~02m 06s      
   |+++++++++                                         | 18% ~02m 09s      
   |++++++++++                                        | 19% ~02m 07s      
   |++++++++++                                        | 20% ~02m 05s      
   |+++++++++++                                       | 21% ~02m 02s      
   |+++++++++++                                       | 22% ~02m 00s      
   |++++++++++++                                      | 23% ~01m 58s      
   |++++++++++++                                      | 24% ~01m 57s      
   |+++++++++++++                                     | 25% ~01m 55s      
   |+++++++++++++                                     | 26% ~01m 53s      
   |++++++++++++++                                    | 27% ~01m 51s      
   |++++++++++++++                                    | 28% ~01m 50s      
   |+++++++++++++++                                   | 29% ~01m 48s      
   |+++++++++++++++                                   | 30% ~01m 46s      
   |++++++++++++++++                                  | 31% ~01m 45s      
   |++++++++++++++++                                  | 32% ~01m 43s      
   |+++++++++++++++++                                 | 33% ~01m 41s      
   |+++++++++++++++++                                | 34% ~01m 40s      
   |++++++++++++++++++                                | 35% ~01m 38s      
   |++++++++++++++++++                                | 36% ~01m 36s      
   |+++++++++++++++++++                               | 37% ~01m 35s      
   |+++++++++++++++++++                               | 38% ~01m 33s      
   |++++++++++++++++++++                              | 39% ~01m 32s      
   |++++++++++++++++++++                              | 40% ~01m 30s      
   |+++++++++++++++++++++                             | 41% ~01m 29s      
   |+++++++++++++++++++++                             | 42% ~01m 27s      
   |++++++++++++++++++++++                            | 43% ~01m 25s      
   |++++++++++++++++++++++                            | 44% ~01m 24s      
   |+++++++++++++++++++++++                           | 45% ~01m 22s      
   |+++++++++++++++++++++++                           | 46% ~01m 21s      
   |++++++++++++++++++++++++                          | 47% ~01m 19s      
   |++++++++++++++++++++++++                          | 48% ~01m 18s      
   |+++++++++++++++++++++++++                         | 49% ~01m 16s      
   |+++++++++++++++++++++++++                         | 50% ~01m 15s      
   |++++++++++++++++++++++++++                        | 51% ~01m 13s      
   |++++++++++++++++++++++++++                        | 52% ~01m 11s      
   |+++++++++++++++++++++++++++                       | 53% ~01m 10s      
   |+++++++++++++++++++++++++++                       | 54% ~01m 08s      
   |++++++++++++++++++++++++++++                      | 55% ~01m 07s      
   |++++++++++++++++++++++++++++                     | 56% ~01m 05s      
   |+++++++++++++++++++++++++++++                     | 57% ~01m 04s      
   |+++++++++++++++++++++++++++++                     | 58% ~01m 02s      
   |++++++++++++++++++++++++++++++                    | 59% ~01m 01s      
   |++++++++++++++++++++++++++++++                    | 60% ~59s          
   |+++++++++++++++++++++++++++++++                   | 61% ~58s          
   |+++++++++++++++++++++++++++++++                   | 62% ~56s          
   |++++++++++++++++++++++++++++++++                  | 63% ~55s          
   |++++++++++++++++++++++++++++++++                  | 64% ~53s          
   |+++++++++++++++++++++++++++++++++                 | 65% ~52s          
   |+++++++++++++++++++++++++++++++++                 | 66% ~50s          
   |++++++++++++++++++++++++++++++++++                | 67% ~49s          
   |++++++++++++++++++++++++++++++++++               | 68% ~47s          
   |+++++++++++++++++++++++++++++++++++               | 69% ~46s          
   |+++++++++++++++++++++++++++++++++++               | 70% ~44s          
   |++++++++++++++++++++++++++++++++++++              | 71% ~43s          
   |++++++++++++++++++++++++++++++++++++              | 72% ~41s          
   |+++++++++++++++++++++++++++++++++++++             | 73% ~40s          
   |+++++++++++++++++++++++++++++++++++++             | 74% ~38s          
   |++++++++++++++++++++++++++++++++++++++            | 75% ~37s          
   |++++++++++++++++++++++++++++++++++++++            | 76% ~35s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~34s          
   |+++++++++++++++++++++++++++++++++++++++          | 78% ~32s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~31s          
   |++++++++++++++++++++++++++++++++++++++++         | 80% ~30s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~28s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~27s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~25s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~24s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~22s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~21s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~19s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~18s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~16s          
   |+++++++++++++++++++++++++++++++++++++++++++++    | 90% ~15s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~13s          
   |++++++++++++++++++++++++++++++++++++++++++++++   | 92% ~12s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~10s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~09s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~07s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~06s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~04s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~03s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~01s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 02m 26s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~02m 06s      
   |++                                                | 2 % ~02m 00s      
   |++                                                | 3 % ~01m 58s      
   |+++                                               | 4 % ~01m 56s      
   |+++                                               | 5 % ~01m 55s      
   |++++                                              | 6 % ~01m 54s      
   |++++                                              | 7 % ~01m 53s      
   |+++++                                             | 8 % ~01m 51s      
   |+++++                                             | 9 % ~01m 51s      
   |++++++                                            | 10% ~01m 51s      
   |++++++                                            | 11% ~01m 49s      
   |+++++++                                           | 12% ~01m 48s      
   |+++++++                                           | 13% ~01m 46s      
   |++++++++                                          | 14% ~01m 45s      
   |++++++++                                          | 15% ~01m 44s      
   |+++++++++                                         | 16% ~01m 43s      
   |+++++++++                                         | 17% ~01m 42s      
   |++++++++++                                        | 18% ~01m 41s      
   |++++++++++                                        | 19% ~01m 40s      
   |+++++++++++                                       | 20% ~01m 39s      
   |+++++++++++                                       | 21% ~01m 38s      
   |++++++++++++                                      | 22% ~01m 37s      
   |++++++++++++                                      | 23% ~01m 35s      
   |+++++++++++++                                     | 24% ~01m 35s      
   |+++++++++++++                                     | 26% ~01m 34s      
   |++++++++++++++                                    | 27% ~01m 32s      
   |++++++++++++++                                    | 28% ~01m 32s      
   |+++++++++++++++                                   | 29% ~01m 30s      
   |+++++++++++++++                                   | 30% ~01m 30s      
   |++++++++++++++++                                  | 31% ~01m 29s      
   |++++++++++++++++                                  | 32% ~01m 28s      
   |+++++++++++++++++                                 | 33% ~01m 26s      
   |+++++++++++++++++                                 | 34% ~01m 25s      
   |++++++++++++++++++                                | 35% ~01m 24s      
   |++++++++++++++++++                                | 36% ~01m 22s      
   |+++++++++++++++++++                               | 37% ~01m 21s      
   |+++++++++++++++++++                               | 38% ~01m 20s      
   |++++++++++++++++++++                              | 39% ~01m 19s      
   |++++++++++++++++++++                              | 40% ~01m 18s      
   |+++++++++++++++++++++                             | 41% ~01m 16s      
   |+++++++++++++++++++++                             | 42% ~01m 15s      
   |++++++++++++++++++++++                            | 43% ~01m 14s      
   |++++++++++++++++++++++                            | 44% ~01m 12s      
   |+++++++++++++++++++++++                           | 45% ~01m 11s      
   |+++++++++++++++++++++++                           | 46% ~01m 10s      
   |++++++++++++++++++++++++                          | 47% ~01m 08s      
   |++++++++++++++++++++++++                          | 48% ~01m 07s      
   |+++++++++++++++++++++++++                         | 49% ~01m 06s      
   |+++++++++++++++++++++++++                         | 50% ~01m 05s      
   |++++++++++++++++++++++++++                        | 51% ~01m 03s      
   |+++++++++++++++++++++++++++                       | 52% ~01m 02s      
   |+++++++++++++++++++++++++++                       | 53% ~01m 01s      
   |++++++++++++++++++++++++++++                      | 54% ~59s          
   |++++++++++++++++++++++++++++                      | 55% ~58s          
   |+++++++++++++++++++++++++++++                     | 56% ~57s          
   |+++++++++++++++++++++++++++++                     | 57% ~55s          
   |++++++++++++++++++++++++++++++                    | 58% ~54s          
   |++++++++++++++++++++++++++++++                    | 59% ~52s          
   |+++++++++++++++++++++++++++++++                   | 60% ~51s          
   |+++++++++++++++++++++++++++++++                   | 61% ~50s          
   |++++++++++++++++++++++++++++++++                  | 62% ~48s          
   |++++++++++++++++++++++++++++++++                  | 63% ~47s          
   |+++++++++++++++++++++++++++++++++                 | 64% ~46s          
   |+++++++++++++++++++++++++++++++++                 | 65% ~44s          
   |++++++++++++++++++++++++++++++++++                | 66% ~43s          
   |++++++++++++++++++++++++++++++++++                | 67% ~42s          
   |+++++++++++++++++++++++++++++++++++               | 68% ~40s          
   |+++++++++++++++++++++++++++++++++++               | 69% ~39s          
   |++++++++++++++++++++++++++++++++++++              | 70% ~38s          
   |++++++++++++++++++++++++++++++++++++              | 71% ~36s          
   |+++++++++++++++++++++++++++++++++++++             | 72% ~35s          
   |+++++++++++++++++++++++++++++++++++++             | 73% ~34s          
   |++++++++++++++++++++++++++++++++++++++            | 74% ~33s          
   |++++++++++++++++++++++++++++++++++++++            | 76% ~31s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~30s          
   |+++++++++++++++++++++++++++++++++++++++           | 78% ~29s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~27s          
   |++++++++++++++++++++++++++++++++++++++++          | 80% ~26s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~25s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~23s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~22s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~21s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~19s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~18s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~17s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~16s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~14s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 90% ~13s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~12s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 92% ~10s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~09s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~08s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~07s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~05s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~04s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~03s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~01s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 02m 07s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~03m 54s      
   |+                                                 | 2 % ~03m 51s      
   |++                                                | 3 % ~03m 47s      
   |++                                                | 4 % ~03m 44s      
   |+++                                               | 5 % ~03m 48s      
   |+++                                               | 6 % ~03m 46s      
   |++++                                              | 7 % ~03m 44s      
   |++++                                              | 8 % ~03m 42s      
   |+++++                                             | 9 % ~03m 40s      
   |+++++                                             | 10% ~03m 38s      
   |++++++                                            | 11% ~03m 35s      
   |++++++                                            | 12% ~03m 33s      
   |+++++++                                           | 13% ~03m 30s      
   |+++++++                                           | 14% ~03m 28s      
   |++++++++                                          | 15% ~03m 25s      
   |++++++++                                          | 16% ~03m 23s      
   |+++++++++                                         | 17% ~03m 20s      
   |+++++++++                                         | 18% ~03m 18s      
   |++++++++++                                        | 19% ~03m 16s      
   |++++++++++                                        | 20% ~03m 13s      
   |+++++++++++                                       | 21% ~03m 10s      
   |+++++++++++                                       | 22% ~03m 08s      
   |++++++++++++                                      | 23% ~03m 06s      
   |++++++++++++                                      | 24% ~03m 04s      
   |+++++++++++++                                     | 25% ~03m 01s      
   |+++++++++++++                                     | 26% ~02m 59s      
   |++++++++++++++                                    | 27% ~02m 56s      
   |++++++++++++++                                    | 28% ~02m 54s      
   |+++++++++++++++                                   | 29% ~02m 52s      
   |+++++++++++++++                                   | 30% ~02m 49s      
   |++++++++++++++++                                  | 31% ~02m 47s      
   |++++++++++++++++                                  | 32% ~02m 45s      
   |+++++++++++++++++                                 | 33% ~02m 42s      
   |+++++++++++++++++                                | 34% ~02m 39s      
   |++++++++++++++++++                                | 35% ~02m 38s      
   |++++++++++++++++++                                | 36% ~02m 35s      
   |+++++++++++++++++++                               | 37% ~02m 33s      
   |+++++++++++++++++++                               | 38% ~02m 31s      
   |++++++++++++++++++++                              | 39% ~02m 28s      
   |++++++++++++++++++++                              | 40% ~02m 26s      
   |+++++++++++++++++++++                             | 41% ~02m 24s      
   |+++++++++++++++++++++                             | 42% ~02m 21s      
   |++++++++++++++++++++++                            | 43% ~02m 19s      
   |++++++++++++++++++++++                            | 44% ~02m 17s      
   |+++++++++++++++++++++++                           | 45% ~02m 14s      
   |+++++++++++++++++++++++                           | 46% ~02m 12s      
   |++++++++++++++++++++++++                          | 47% ~02m 10s      
   |++++++++++++++++++++++++                          | 48% ~02m 10s      
   |+++++++++++++++++++++++++                         | 49% ~02m 10s      
   |+++++++++++++++++++++++++                         | 50% ~02m 07s      
   |++++++++++++++++++++++++++                        | 51% ~02m 04s      
   |++++++++++++++++++++++++++                        | 52% ~02m 01s      
   |+++++++++++++++++++++++++++                       | 53% ~01m 59s      
   |+++++++++++++++++++++++++++                       | 54% ~01m 56s      
   |++++++++++++++++++++++++++++                      | 55% ~01m 54s      
   |++++++++++++++++++++++++++++                     | 56% ~01m 51s      
   |+++++++++++++++++++++++++++++                     | 57% ~01m 49s      
   |+++++++++++++++++++++++++++++                     | 58% ~01m 46s      
   |++++++++++++++++++++++++++++++                    | 59% ~01m 44s      
   |++++++++++++++++++++++++++++++                    | 60% ~01m 41s      
   |+++++++++++++++++++++++++++++++                   | 61% ~01m 38s      
   |+++++++++++++++++++++++++++++++                   | 62% ~01m 36s      
   |++++++++++++++++++++++++++++++++                  | 63% ~01m 33s      
   |++++++++++++++++++++++++++++++++                  | 64% ~01m 31s      
   |+++++++++++++++++++++++++++++++++                 | 65% ~01m 28s      
   |+++++++++++++++++++++++++++++++++                 | 66% ~01m 25s      
   |++++++++++++++++++++++++++++++++++                | 67% ~01m 23s      
   |++++++++++++++++++++++++++++++++++               | 68% ~01m 20s      
   |+++++++++++++++++++++++++++++++++++               | 69% ~01m 18s      
   |+++++++++++++++++++++++++++++++++++               | 70% ~01m 16s      
   |++++++++++++++++++++++++++++++++++++              | 71% ~01m 13s      
   |++++++++++++++++++++++++++++++++++++              | 72% ~01m 10s      
   |+++++++++++++++++++++++++++++++++++++             | 73% ~01m 08s      
   |+++++++++++++++++++++++++++++++++++++             | 74% ~01m 05s      
   |++++++++++++++++++++++++++++++++++++++            | 75% ~01m 03s      
   |++++++++++++++++++++++++++++++++++++++            | 76% ~01m 00s      
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~58s          
   |+++++++++++++++++++++++++++++++++++++++          | 78% ~55s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~53s          
   |++++++++++++++++++++++++++++++++++++++++         | 80% ~50s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~48s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~45s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~43s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~40s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~38s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~35s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~33s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~30s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~28s          
   |+++++++++++++++++++++++++++++++++++++++++++++    | 90% ~25s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~23s          
   |++++++++++++++++++++++++++++++++++++++++++++++   | 92% ~20s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~18s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~15s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~13s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~10s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~08s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~05s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~03s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 04m 09s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~02m 39s      
   |++                                                | 2 % ~02m 36s      
   |++                                                | 3 % ~02m 34s      
   |+++                                               | 4 % ~02m 29s      
   |+++                                               | 5 % ~02m 25s      
   |++++                                              | 6 % ~02m 21s      
   |++++                                              | 7 % ~02m 22s      
   |+++++                                             | 8 % ~02m 21s      
   |+++++                                             | 9 % ~02m 19s      
   |++++++                                            | 10% ~02m 17s      
   |++++++                                            | 11% ~02m 17s      
   |+++++++                                           | 12% ~02m 15s      
   |+++++++                                           | 13% ~02m 13s      
   |++++++++                                          | 14% ~02m 14s      
   |++++++++                                          | 15% ~02m 22s      
   |+++++++++                                         | 16% ~02m 22s      
   |+++++++++                                         | 17% ~02m 20s      
   |++++++++++                                        | 18% ~02m 19s      
   |++++++++++                                        | 19% ~02m 16s      
   |+++++++++++                                       | 20% ~02m 14s      
   |+++++++++++                                       | 21% ~02m 11s      
   |++++++++++++                                      | 22% ~02m 09s      
   |++++++++++++                                      | 23% ~02m 07s      
   |+++++++++++++                                     | 24% ~02m 04s      
   |+++++++++++++                                     | 25% ~02m 02s      
   |++++++++++++++                                    | 26% ~01m 60s      
   |++++++++++++++                                    | 27% ~01m 58s      
   |+++++++++++++++                                   | 28% ~01m 56s      
   |+++++++++++++++                                   | 29% ~01m 53s      
   |++++++++++++++++                                  | 30% ~01m 51s      
   |++++++++++++++++                                  | 31% ~01m 49s      
   |+++++++++++++++++                                 | 32% ~01m 47s      
   |+++++++++++++++++                                 | 33% ~01m 45s      
   |++++++++++++++++++                                | 34% ~01m 44s      
   |++++++++++++++++++                                | 35% ~01m 42s      
   |+++++++++++++++++++                               | 36% ~01m 40s      
   |+++++++++++++++++++                               | 37% ~01m 38s      
   |++++++++++++++++++++                              | 38% ~01m 37s      
   |++++++++++++++++++++                              | 39% ~01m 36s      
   |+++++++++++++++++++++                             | 40% ~01m 34s      
   |+++++++++++++++++++++                             | 41% ~01m 32s      
   |++++++++++++++++++++++                            | 42% ~01m 31s      
   |++++++++++++++++++++++                            | 43% ~01m 29s      
   |+++++++++++++++++++++++                           | 44% ~01m 28s      
   |+++++++++++++++++++++++                           | 45% ~01m 26s      
   |++++++++++++++++++++++++                          | 46% ~01m 25s      
   |++++++++++++++++++++++++                          | 47% ~01m 23s      
   |+++++++++++++++++++++++++                         | 48% ~01m 21s      
   |+++++++++++++++++++++++++                         | 49% ~01m 19s      
   |++++++++++++++++++++++++++                        | 51% ~01m 17s      
   |++++++++++++++++++++++++++                        | 52% ~01m 16s      
   |+++++++++++++++++++++++++++                       | 53% ~01m 14s      
   |+++++++++++++++++++++++++++                       | 54% ~01m 12s      
   |++++++++++++++++++++++++++++                      | 55% ~01m 11s      
   |++++++++++++++++++++++++++++                      | 56% ~01m 09s      
   |+++++++++++++++++++++++++++++                     | 57% ~01m 07s      
   |+++++++++++++++++++++++++++++                     | 58% ~01m 06s      
   |++++++++++++++++++++++++++++++                    | 59% ~01m 04s      
   |++++++++++++++++++++++++++++++                    | 60% ~01m 03s      
   |+++++++++++++++++++++++++++++++                   | 61% ~01m 01s      
   |+++++++++++++++++++++++++++++++                   | 62% ~59s          
   |++++++++++++++++++++++++++++++++                  | 63% ~58s          
   |++++++++++++++++++++++++++++++++                  | 64% ~56s          
   |+++++++++++++++++++++++++++++++++                 | 65% ~54s          
   |+++++++++++++++++++++++++++++++++                 | 66% ~53s          
   |++++++++++++++++++++++++++++++++++                | 67% ~51s          
   |++++++++++++++++++++++++++++++++++                | 68% ~50s          
   |+++++++++++++++++++++++++++++++++++               | 69% ~48s          
   |+++++++++++++++++++++++++++++++++++               | 70% ~47s          
   |++++++++++++++++++++++++++++++++++++              | 71% ~45s          
   |++++++++++++++++++++++++++++++++++++              | 72% ~43s          
   |+++++++++++++++++++++++++++++++++++++             | 73% ~42s          
   |+++++++++++++++++++++++++++++++++++++             | 74% ~40s          
   |++++++++++++++++++++++++++++++++++++++            | 75% ~39s          
   |++++++++++++++++++++++++++++++++++++++            | 76% ~37s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~35s          
   |+++++++++++++++++++++++++++++++++++++++           | 78% ~34s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~32s          
   |++++++++++++++++++++++++++++++++++++++++          | 80% ~31s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~29s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~28s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~26s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~25s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~23s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~22s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~20s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~19s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~17s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 90% ~16s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~14s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 92% ~12s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~11s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~09s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~08s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~06s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~05s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~03s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~02s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 02m 35s

   |                                                  | 0 % ~calculating  
   |+                                                 | 1 % ~04m 18s      
   |++                                                | 2 % ~04m 59s      
   |++                                                | 3 % ~04m 57s      
   |+++                                               | 4 % ~04m 41s      
   |+++                                               | 5 % ~04m 25s      
   |++++                                              | 6 % ~04m 13s      
   |++++                                              | 7 % ~04m 03s      
   |+++++                                             | 8 % ~03m 57s      
   |+++++                                             | 9 % ~03m 53s      
   |++++++                                            | 10% ~03m 47s      
   |++++++                                            | 11% ~03m 44s      
   |+++++++                                           | 12% ~03m 39s      
   |+++++++                                           | 13% ~03m 37s      
   |++++++++                                          | 14% ~03m 35s      
   |++++++++                                          | 15% ~03m 30s      
   |+++++++++                                         | 16% ~03m 26s      
   |+++++++++                                         | 17% ~03m 23s      
   |++++++++++                                        | 18% ~03m 25s      
   |++++++++++                                        | 19% ~03m 26s      
   |+++++++++++                                       | 20% ~03m 27s      
   |+++++++++++                                       | 21% ~03m 24s      
   |++++++++++++                                      | 22% ~03m 21s      
   |++++++++++++                                      | 23% ~03m 17s      
   |+++++++++++++                                     | 24% ~03m 14s      
   |+++++++++++++                                     | 25% ~03m 11s      
   |++++++++++++++                                    | 26% ~03m 07s      
   |++++++++++++++                                    | 27% ~03m 04s      
   |+++++++++++++++                                   | 28% ~03m 01s      
   |+++++++++++++++                                   | 29% ~02m 57s      
   |++++++++++++++++                                  | 30% ~02m 54s      
   |++++++++++++++++                                  | 31% ~02m 51s      
   |+++++++++++++++++                                 | 32% ~02m 48s      
   |+++++++++++++++++                                 | 33% ~02m 45s      
   |++++++++++++++++++                                | 34% ~02m 43s      
   |++++++++++++++++++                                | 35% ~02m 40s      
   |+++++++++++++++++++                               | 36% ~02m 37s      
   |+++++++++++++++++++                               | 37% ~02m 34s      
   |++++++++++++++++++++                              | 38% ~02m 31s      
   |++++++++++++++++++++                              | 39% ~02m 29s      
   |+++++++++++++++++++++                             | 40% ~02m 26s      
   |+++++++++++++++++++++                             | 41% ~02m 23s      
   |++++++++++++++++++++++                            | 42% ~02m 21s      
   |++++++++++++++++++++++                            | 43% ~02m 18s      
   |+++++++++++++++++++++++                           | 44% ~02m 16s      
   |+++++++++++++++++++++++                           | 45% ~02m 13s      
   |++++++++++++++++++++++++                          | 46% ~02m 11s      
   |++++++++++++++++++++++++                          | 47% ~02m 08s      
   |+++++++++++++++++++++++++                         | 48% ~02m 05s      
   |+++++++++++++++++++++++++                         | 49% ~02m 03s      
   |++++++++++++++++++++++++++                        | 51% ~02m 00s      
   |++++++++++++++++++++++++++                        | 52% ~01m 59s      
   |+++++++++++++++++++++++++++                       | 53% ~01m 56s      
   |+++++++++++++++++++++++++++                       | 54% ~01m 54s      
   |++++++++++++++++++++++++++++                      | 55% ~01m 52s      
   |++++++++++++++++++++++++++++                      | 56% ~01m 49s      
   |+++++++++++++++++++++++++++++                     | 57% ~01m 47s      
   |+++++++++++++++++++++++++++++                     | 58% ~01m 44s      
   |++++++++++++++++++++++++++++++                    | 59% ~01m 42s      
   |++++++++++++++++++++++++++++++                    | 60% ~01m 39s      
   |+++++++++++++++++++++++++++++++                   | 61% ~01m 37s      
   |+++++++++++++++++++++++++++++++                   | 62% ~01m 34s      
   |++++++++++++++++++++++++++++++++                  | 63% ~01m 31s      
   |++++++++++++++++++++++++++++++++                  | 64% ~01m 29s      
   |+++++++++++++++++++++++++++++++++                 | 65% ~01m 26s      
   |+++++++++++++++++++++++++++++++++                 | 66% ~01m 24s      
   |++++++++++++++++++++++++++++++++++                | 67% ~01m 21s      
   |++++++++++++++++++++++++++++++++++                | 68% ~01m 19s      
   |+++++++++++++++++++++++++++++++++++               | 69% ~01m 16s      
   |+++++++++++++++++++++++++++++++++++               | 70% ~01m 14s      
   |++++++++++++++++++++++++++++++++++++              | 71% ~01m 11s      
   |++++++++++++++++++++++++++++++++++++              | 72% ~01m 09s      
   |+++++++++++++++++++++++++++++++++++++             | 73% ~01m 06s      
   |+++++++++++++++++++++++++++++++++++++             | 74% ~01m 04s      
   |++++++++++++++++++++++++++++++++++++++            | 75% ~01m 02s      
   |++++++++++++++++++++++++++++++++++++++            | 76% ~59s          
   |+++++++++++++++++++++++++++++++++++++++           | 77% ~57s          
   |+++++++++++++++++++++++++++++++++++++++           | 78% ~54s          
   |++++++++++++++++++++++++++++++++++++++++          | 79% ~52s          
   |++++++++++++++++++++++++++++++++++++++++          | 80% ~49s          
   |+++++++++++++++++++++++++++++++++++++++++         | 81% ~47s          
   |+++++++++++++++++++++++++++++++++++++++++         | 82% ~44s          
   |++++++++++++++++++++++++++++++++++++++++++        | 83% ~42s          
   |++++++++++++++++++++++++++++++++++++++++++        | 84% ~39s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 85% ~37s          
   |+++++++++++++++++++++++++++++++++++++++++++       | 86% ~34s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 87% ~32s          
   |++++++++++++++++++++++++++++++++++++++++++++      | 88% ~30s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 89% ~27s          
   |+++++++++++++++++++++++++++++++++++++++++++++     | 90% ~25s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 91% ~22s          
   |++++++++++++++++++++++++++++++++++++++++++++++    | 92% ~20s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 93% ~17s          
   |+++++++++++++++++++++++++++++++++++++++++++++++   | 94% ~15s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 95% ~12s          
   |++++++++++++++++++++++++++++++++++++++++++++++++  | 96% ~10s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 97% ~07s          
   |+++++++++++++++++++++++++++++++++++++++++++++++++ | 98% ~05s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 99% ~02s          
   |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed = 04m 04s

Display the top markers you computed above.

tiss.markers %>% group_by(cluster) %>% top_n(20, avg_logFC)

Generate an expression heatmap for given cells and genes. In this case, we are plotting the top 20 markers (or all markers if less than 20) for each cluster.

Assigning cell type identity to clusters

At a coarse level, we can use canonical markers to match the unbiased clustering to known cell types:

0: basal cell of epidermis (CL:0002187) 1: basal cell of epidermis (CL:0002187) 2: proliferating basal cell of epidermis (CL:0002187) 3: differentiated keratinocytes (CL:0000312) 4: differentiating basal cell of epidermis (CL:0002187) 5: suprabasal differentiating keratinocytes (CL:0000312) 6: basal cell of epidermis (CL:0002187) 7: filiform differentiated keratinocytes (CL:0000312)

# stash current cluster IDs
tiss <- StashIdent(object = tiss, save.name = "cluster.ids")
# enumerate current cluster IDs and the labels for them
cluster.ids <- c(0, 1, 2, 3, 4, 5, 6, 7)
free_annotation <- c(
"basal cells", 
"basal cells", 
"proliferating", 
"differentiated keratinocyte", 
"differentiating basal cells", 
"suprabasal differentiating keratinocytes", 
"basal cells",
"filiform differentiated keratinocytes" 
)
cell_ontology_class <- c(
  "basal cell of epidermis", 
  "basal cell of epidermis", 
  "basal cell of epidermis", 
  "keratinocyte",
  "basal cell of epidermis",
  "keratinocyte",
  "basal cell of epidermis",
  "keratinocyte"
)
cell_ontology_id <- c(
  "CL:0002187",
  "CL:0002187", 
  "CL:0002187",
  "CL:0000312",
  "CL:0002187",
  "CL:0000312",
  "CL:0002187",
  "CL:0000312"
)
tiss@meta.data[,'free_annotation'] <- plyr::mapvalues(x = tiss@ident, from = cluster.ids, to = free_annotation)
tiss@meta.data[,'cell_ontology_class'] <- plyr::mapvalues(x = tiss@ident, from = cluster.ids, to = cell_ontology_class)
tiss@meta.data[,'cell_ontology_id'] <- plyr::mapvalues(x = tiss@ident, from = cluster.ids, to = cell_ontology_id)
TSNEPlot(object = tiss, do.label = TRUE, pt.size = 0.5, group.by='cell_ontology_class')

Supplementary Figures

Fig. suppTongue1. tSNE based on free annotation

Fig. suppTongue2. Expression of genes used for annotation of the clusters. Feature plot from both platforms on: Top2a, Cdc20, Mki67, Krt15, Krt5, Krt14, Sbsn, Krt10, Krt4, Krt13, Krt36, Krt84, Hoxc13

Fig. suppTongue3. Expression of genes known to be expressed in taste receptor cells. Violin plot from both platforms on: Krt8, Tas1r1, Tas1r2, Tas1r3, Ncam1, Car4

Checking for batch effects

Color by metadata, like plate barcode, to check for batch effects.

TSNEPlot(object = tiss, do.return = TRUE, group.by = "mouse.sex")

Print a table showing the count of cells in each identity category from each plate.

table(as.character(tiss@ident), as.character(tiss@meta.data$plate.barcode))
   
    B002777 B002780 D041894 D041904 D041911
  0      61      58      90      79      80
  1      46      12      67      56      72
  2      85      24      28      45      14
  3      40      19      38      46      39
  4      20       8      44      48      41
  5      10       5      35      34      37
  6       1       7      29      14      57
  7       3       3       7      11       3

Save the Robject for later

When you save the annotated tissue, please give it a name.

filename = here('00_data_ingest', '04_tissue_robj_generated', 
                     paste0("facs", tissue_of_interest, "_seurat_tiss.Robj"))
print(filename)
[1] "/Users/Jintonic/Documents/GitHub/tabula-muris/00_data_ingest/04_tissue_robj_generated/facsTongue_seurat_tiss.Robj"
save(tiss, file=filename)
# To reload a saved object
filename = here('00_data_ingest', '04_tissue_robj_generated', 
                      paste0("facs", tissue_of_interest, "_seurat_tiss.Robj"))
load(file=filename)

Export the final metadata

So that Biohub can easily combine all your cell_ontology_classs, please export them as a simple csv.

head(tiss@meta.data)
filename = here('00_data_ingest', '03_tissue_annotation_csv', 
          paste0(tissue_of_interest, "_facs_cell_ontology_class.csv"))
write.csv(FetchData(tiss, c('plate.barcode','cell_ontology_class','cell_ontology_id', 'free_annotation', 'tSNE_1', 'tSNE_2')), file=filename)
LS0tCnRpdGxlOiAiVG9uZ3VlIEZBQ1MgTm90ZWJvb2siCm91dHB1dDogaHRtbF9ub3RlYm9vawotLS0KClNwZWNpZnkgdGhlIHRpc3N1ZSBvZiBpbnRlcmVzdCwgcnVuIHRoZSBib2lsZXJwbGF0ZSBjb2RlIHdoaWNoIHNldHMgdXAgdGhlIGZ1bmN0aW9ucyBhbmQgZW52aXJvbm1lbnQsIGxvYWQgdGhlIHRpc3N1ZSBvYmplY3QuCgpgYGB7cn0KdGlzc3VlX29mX2ludGVyZXN0ID0gIlRvbmd1ZSIKbGlicmFyeShoZXJlKQpzb3VyY2UoaGVyZSgiMDBfZGF0YV9pbmdlc3QiLCAiMDJfdGlzc3VlX2FuYWx5c2lzX3JtZCIsICJib2lsZXJwbGF0ZS5SIikpCnRpc3MgPSBsb2FkX3Rpc3N1ZV9mYWNzKHRpc3N1ZV9vZl9pbnRlcmVzdCkKYGBgCgpWaXN1YWxpemUgdG9wIGdlbmVzIGluIHByaW5jaXBhbCBjb21wb25lbnRzCgpgYGB7ciwgZWNobz1GQUxTRSwgZmlnLmhlaWdodD0xNiwgZmlnLndpZHRoPTh9ClBDSGVhdG1hcChvYmplY3QgPSB0aXNzLCBwYy51c2UgPSAxOjEwLCBjZWxscy51c2UgPSA1MDAsIGRvLmJhbGFuY2VkID0gVFJVRSwgCiAgICBsYWJlbC5jb2x1bW5zID0gRkFMU0UsIHVzZS5mdWxsID0gRkFMU0UpCmBgYAoKTGF0ZXIgb24gKGluIEZpbmRDbHVzdGVycyBhbmQgVFNORSkgeW91IHdpbGwgcGljayBhIG51bWJlciBvZiBwcmluY2lwYWwgY29tcG9uZW50cyB0byB1c2UuIFRoaXMgaGFzIHRoZSBlZmZlY3Qgb2Yga2VlcGluZyB0aGUgbWFqb3IgZGlyZWN0aW9ucyBvZiB2YXJpYXRpb24gaW4gdGhlIGRhdGEgYW5kLCBpZGVhbGx5LCBzdXByZXNzaW5nIG5vaXNlLiBUaGVyZSBpcyBubyBjb3JyZWN0IGFuc3dlciB0byB0aGUgbnVtYmVyIHRvIHVzZSwgYnV0IGEgZGVjZW50IHJ1bGUgb2YgdGh1bWIgaXMgdG8gZ28gdW50aWwgdGhlIHBsb3QgcGxhdGVhdXMuCgpgYGB7cn0KUENFbGJvd1Bsb3Qob2JqZWN0ID0gdGlzcykKYGBgCgpDaG9vc2UgdGhlIG51bWJlciBvZiBwcmluY2lwYWwgY29tcG9uZW50cyB0byB1c2UuCmBgYHtyfQojIFNldCBudW1iZXIgb2YgcHJpbmNpcGFsIGNvbXBvbmVudHMuIApuLnBjcyA9IDEwCmBgYAoKClRoZSBjbHVzdGVyaW5nIGlzIHBlcmZvcm1lZCBiYXNlZCBvbiBhIG5lYXJlc3QgbmVpZ2hib3JzIGdyYXBoLiBDZWxscyB0aGF0IGhhdmUgc2ltaWxhciBleHByZXNzaW9uIHdpbGwgYmUgam9pbmVkIHRvZ2V0aGVyLiBUaGUgTG91dmFpbiBhbGdvcml0aG0gbG9va3MgZm9yIGdyb3VwcyBvZiBjZWxscyB3aXRoIGhpZ2ggbW9kdWxhcml0eS0tbW9yZSBjb25uZWN0aW9ucyB3aXRoaW4gdGhlIGdyb3VwIHRoYW4gYmV0d2VlbiBncm91cHMuIFRoZSByZXNvbHV0aW9uIHBhcmFtZXRlciBkZXRlcm1pbmVzIHRoZSBzY2FsZS4uLmhpZ2hlciByZXNvbHV0aW9uIHdpbGwgZ2l2ZSBtb3JlIGNsdXN0ZXJzLCBsb3dlciByZXNvbHV0aW9uIHdpbGwgZ2l2ZSBmZXdlci4KCkZvciB0aGUgdG9wLWxldmVsIGNsdXN0ZXJpbmcsIGFpbSB0byB1bmRlci1jbHVzdGVyIGluc3RlYWQgb2Ygb3Zlci1jbHVzdGVyLiBJdCB3aWxsIGJlIGVhc3kgdG8gc3Vic2V0IGdyb3VwcyBhbmQgZnVydGhlciBhbmFseXplIHRoZW0gYmVsb3cuCgpgYGB7cn0KIyBTZXQgcmVzb2x1dGlvbiAKcmVzLnVzZWQgPC0gMC43Cgp0aXNzIDwtIEZpbmRDbHVzdGVycyhvYmplY3QgPSB0aXNzLCByZWR1Y3Rpb24udHlwZSA9ICJwY2EiLCBkaW1zLnVzZSA9IDE6bi5wY3MsIAogICAgcmVzb2x1dGlvbiA9IHJlcy51c2VkLCBwcmludC5vdXRwdXQgPSAwLCBzYXZlLlNOTiA9IFRSVUUsIGZvcmNlLnJlY2FsYyA9IFRSVUUpCmBgYAoKVG8gdmlzdWFsaXplIApgYGB7cn0KIyBJZiBjZWxscyBhcmUgdG9vIHNwcmVhZCBvdXQsIHlvdSBjYW4gcmFpc2UgdGhlIHBlcnBsZXhpdHkuIElmIHlvdSBoYXZlIGZldyBjZWxscywgdHJ5IGEgbG93ZXIgcGVycGxleGl0eSAoYnV0IG5ldmVyIGxlc3MgdGhhbiAxMCkuCnRpc3MgPC0gUnVuVFNORShvYmplY3QgPSB0aXNzLCBkaW1zLnVzZSA9IDE6bi5wY3MsIHNlZWQudXNlID0gMjAsIHBlcnBsZXhpdHk9MzApCiMgbm90ZSB0aGF0IHlvdSBjYW4gc2V0IGRvLmxhYmVsPVQgdG8gaGVscCBsYWJlbCBpbmRpdmlkdWFsIGNsdXN0ZXJzClRTTkVQbG90KG9iamVjdCA9IHRpc3MsIGRvLmxhYmVsID0gVCwgcHQuc2l6ZSA9IDEuMiwgbGFiZWwuc2l6ZSA9IDQpCgpgYGAKCgpDaGVjayBleHByZXNzaW9uIG9mIGdlbmVzIG9mIGludGVyc2V0LgoKYGBge3IsIGVjaG89RkFMU0UsIGZpZy5oZWlnaHQ9MTYsIGZpZy53aWR0aD0xMH0KZ2VuZXNfdG9fY2hlY2sgPSBjKCdUb3AyYScsICdDZGMyMCcsICdNa2k2NycsICdLcnQxNScsICdLcnQ1JywgJ0tydDE0JywgJ1Nic24nLCAnS3J0MTAnLCAnS3J0NCcsICdLcnQxMycsICdLcnQzNicsICdLcnQ4NCcsICdIb3hjMTMnLCAnS3J0OCcsICdUYXMxcjEnLCAnVGFzMXIyJywgJ1RhczFyMycsICdOY2FtMScsICdDYXI0JykKCkZlYXR1cmVQbG90KHRpc3MsIGdlbmVzX3RvX2NoZWNrLCBwdC5zaXplID0gMS4yLCBuQ29sID0gMykKYGBgCgpEb3RwbG90cyBsZXQgeW91IHNlZSB0aGUgaW50ZW5zaXR5IG9mIGV4cHByZXNzaW9uIGFuZCB0aGUgZnJhY3Rpb24gb2YgY2VsbHMgZXhwcmVzc2luZyBmb3IgZWFjaCBvZiB5b3VyIGdlbmVzIG9mIGludGVyZXN0LgoKYGBge3IsIGVjaG89RkFMU0UsIGZpZy5oZWlnaHQ9NCwgZmlnLndpZHRoPTIwfQojIFRvIGNoYW5nZSB0aGUgeS1heGlzIHRvIHNob3cgcmF3IGNvdW50cywgYWRkIHVzZS5yYXcgPSBULgpEb3RQbG90KHRpc3MsIGdlbmVzX3RvX2NoZWNrLCBwbG90LmxlZ2VuZCA9IFQpCmBgYAoKYGBge3IsIGVjaG89RkFMU0UsIGZpZy5oZWlnaHQ9MjAsIGZpZy53aWR0aD0yMH0KIyBUbyBjaGFuZ2UgdGhlIHktYXhpcyB0byBzaG93IHJhdyBjb3VudHMsIGFkZCB1c2UucmF3ID0gVC4KVmxuUGxvdCh0aXNzLCBnZW5lc190b19jaGVjaykKYGBgCgpIb3cgYmlnIGFyZSB0aGUgY2x1c3RlcnM/CmBgYHtyfQp0YWJsZSh0aXNzQGlkZW50KQpgYGAKCmBgYHtyfQp0aXNzMT1CdWlsZENsdXN0ZXJUcmVlKHRpc3MpCmBgYAoKV2hpY2ggbWFya2VycyBpZGVudGlmeSBhIHNwZWNpZmljIGNsdXN0ZXI/CgpgYGB7cn0KI2NsdXN0ZXIxLm1hcmtlcnMgPC0gRmluZE1hcmtlcnMob2JqZWN0ID0gdGlzcywgaWRlbnQuMSA9IDEsIG1pbi5wY3QgPSAwLjI1LCBvbmx5LnBvcyA9IFRSVUUsIHRocmVzaC51c2UgPSAwLjI1KQojY2x1c3RlcjIubWFya2VycyA8LSBGaW5kTWFya2VycyhvYmplY3QgPSB0aXNzLCBpZGVudC4xID0gMiwgbWluLnBjdCA9IDAuMjUsIG9ubHkucG9zID0gVFJVRSwgdGhyZXNoLnVzZSA9IDAuMjUpCiNjbHVzdGVyMy5tYXJrZXJzIDwtIEZpbmRNYXJrZXJzKG9iamVjdCA9IHRpc3MsIGlkZW50LjEgPSAzLCBtaW4ucGN0ID0gMC4yNSwgb25seS5wb3MgPSBUUlVFLCB0aHJlc2gudXNlID0gMC4yNSkKI2NsdXN0ZXI0Lm1hcmtlcnMgPC0gRmluZE1hcmtlcnMob2JqZWN0ID0gdGlzcywgaWRlbnQuMSA9IDQsIG1pbi5wY3QgPSAwLjI1LCBvbmx5LnBvcyA9IFRSVUUsIHRocmVzaC51c2UgPSAwLjI1KQojY2x1c3RlcjUubWFya2VycyA8LSBGaW5kTWFya2VycyhvYmplY3QgPSB0aXNzLCBpZGVudC4xID0gNSwgbWluLnBjdCA9IDAuMjUsIG9ubHkucG9zID0gVFJVRSwgdGhyZXNoLnVzZSA9IDAuMjUpCiNjbHVzdGVyNi5tYXJrZXJzIDwtIEZpbmRNYXJrZXJzKG9iamVjdCA9IHRpc3MsIGlkZW50LjEgPSA2LCBtaW4ucGN0ID0gMC4yNSwgb25seS5wb3MgPSBUUlVFLCB0aHJlc2gudXNlID0gMC4yNSkKY2x1c3RlcjcubWFya2VycyA8LSBGaW5kTWFya2VycyhvYmplY3QgPSB0aXNzLCBpZGVudC4xID0gNiwgbWluLnBjdCA9IDAuMjUsIG9ubHkucG9zID0gVFJVRSwgdGhyZXNoLnVzZSA9IDAuMjUpCiNjbHVzdGVyMC5tYXJrZXJzIDwtIEZpbmRNYXJrZXJzKG9iamVjdCA9IHRpc3MsIGlkZW50LjEgPSAwLCBtaW4ucGN0ID0gMC4yNSwgb25seS5wb3MgPSBUUlVFLCB0aHJlc2gudXNlID0gMC4yNSkKYGBgCgpgYGB7cn0KcHJpbnQoeCA9IGhlYWQoeCA9IGNsdXN0ZXI2Lm1hcmtlcnMsIG4gPSAzMCkpCmBgYAoKWW91IGNhbiBhbHNvIGNvbXB1dGUgYWxsIG1hcmtlcnMgZm9yIGFsbCBjbHVzdGVycyBhdCBvbmNlLiBUaGlzIG1heSB0YWtlIHNvbWUgdGltZS4KYGBge3J9CnRpc3MubWFya2VycyA8LSBGaW5kQWxsTWFya2VycyhvYmplY3QgPSB0aXNzLCBvbmx5LnBvcyA9IFRSVUUsIG1pbi5wY3QgPSAwLjI1LCB0aHJlc2gudXNlID0gMC4yNSkKYGBgCgpEaXNwbGF5IHRoZSB0b3AgbWFya2VycyB5b3UgY29tcHV0ZWQgYWJvdmUuCmBgYHtyfQp0aXNzLm1hcmtlcnMgJT4lIGdyb3VwX2J5KGNsdXN0ZXIpICU+JSB0b3BfbigyMCwgYXZnX2xvZ0ZDKQpgYGAKCiMjIEdlbmVyYXRlIGFuIGV4cHJlc3Npb24gaGVhdG1hcCBmb3IgZ2l2ZW4gY2VsbHMgYW5kIGdlbmVzLiBJbiB0aGlzIGNhc2UsIHdlIGFyZSBwbG90dGluZyB0aGUgdG9wIDIwIG1hcmtlcnMgKG9yIGFsbCBtYXJrZXJzIGlmIGxlc3MgdGhhbiAyMCkgZm9yIGVhY2ggY2x1c3Rlci4KCmBgYHtyLCBlY2hvPUZBTFNFLCBmaWcuaGVpZ2h0PTUwLCBmaWcud2lkdGg9MzV9CiN0b3AxMCA8LSB0aXNzLm1hcmtlcnMgJT4lIGdyb3VwX2J5KGNsdXN0ZXIpICU+JSB0b3BfbigxMCwgYXZnX2xvZ0ZDKQp0b3AyMCA8LSB0aXNzLm1hcmtlcnMgJT4lIGdyb3VwX2J5KGNsdXN0ZXIpICU+JSB0b3BfbigyMCwgYXZnX2xvZ0ZDKQojIHNldHRpbmcgc2xpbS5jb2wubGFiZWwgdG8gVFJVRSB3aWxsIHByaW50IGp1c3QgdGhlIGNsdXN0ZXIgSURTIGluc3RlYWQgb2YKIyBldmVyeSBjZWxsIG5hbWUKRG9IZWF0bWFwKHRpc3MsIGdlbmVzLnVzZSA9IHRvcDIwJGdlbmUsIHJlbW92ZS5rZXkgPSBUUlVFLCBjZXgucm93ID0gMjAsIGdyb3VwLmNleCA9IDIwICkKYGBgCiMjIEFzc2lnbmluZyBjZWxsIHR5cGUgaWRlbnRpdHkgdG8gY2x1c3RlcnMKCkF0IGEgY29hcnNlIGxldmVsLCB3ZSBjYW4gdXNlIGNhbm9uaWNhbCBtYXJrZXJzIHRvIG1hdGNoIHRoZSB1bmJpYXNlZCBjbHVzdGVyaW5nIHRvIGtub3duIGNlbGwgdHlwZXM6CgowOiBiYXNhbCBjZWxsIG9mIGVwaWRlcm1pcyAoQ0w6MDAwMjE4NykKMTogYmFzYWwgY2VsbCBvZiBlcGlkZXJtaXMgKENMOjAwMDIxODcpCjI6IHByb2xpZmVyYXRpbmcgYmFzYWwgY2VsbCBvZiBlcGlkZXJtaXMgKENMOjAwMDIxODcpCjM6IGRpZmZlcmVudGlhdGVkIGtlcmF0aW5vY3l0ZXMgKENMOjAwMDAzMTIpCjQ6IGRpZmZlcmVudGlhdGluZyBiYXNhbCBjZWxsIG9mIGVwaWRlcm1pcyAoQ0w6MDAwMjE4NykKNTogc3VwcmFiYXNhbCBkaWZmZXJlbnRpYXRpbmcga2VyYXRpbm9jeXRlcyAgKENMOjAwMDAzMTIpCjY6IGJhc2FsIGNlbGwgb2YgZXBpZGVybWlzIChDTDowMDAyMTg3KQo3OiBmaWxpZm9ybSBkaWZmZXJlbnRpYXRlZCBrZXJhdGlub2N5dGVzIChDTDowMDAwMzEyKQoKYGBge3J9CiMgc3Rhc2ggY3VycmVudCBjbHVzdGVyIElEcwp0aXNzIDwtIFN0YXNoSWRlbnQob2JqZWN0ID0gdGlzcywgc2F2ZS5uYW1lID0gImNsdXN0ZXIuaWRzIikKIyBlbnVtZXJhdGUgY3VycmVudCBjbHVzdGVyIElEcyBhbmQgdGhlIGxhYmVscyBmb3IgdGhlbQpjbHVzdGVyLmlkcyA8LSBjKDAsIDEsIDIsIDMsIDQsIDUsIDYsIDcpCgpmcmVlX2Fubm90YXRpb24gPC0gYygKImJhc2FsIGNlbGxzIiwgCiJiYXNhbCBjZWxscyIsIAoicHJvbGlmZXJhdGluZyIsIAoiZGlmZmVyZW50aWF0ZWQga2VyYXRpbm9jeXRlIiwgCiJkaWZmZXJlbnRpYXRpbmcgYmFzYWwgY2VsbHMiLCAKInN1cHJhYmFzYWwgZGlmZmVyZW50aWF0aW5nIGtlcmF0aW5vY3l0ZXMiLCAKImJhc2FsIGNlbGxzIiwKImZpbGlmb3JtIGRpZmZlcmVudGlhdGVkIGtlcmF0aW5vY3l0ZXMiIAopCgpjZWxsX29udG9sb2d5X2NsYXNzIDwtIGMoCiAgImJhc2FsIGNlbGwgb2YgZXBpZGVybWlzIiwgCiAgImJhc2FsIGNlbGwgb2YgZXBpZGVybWlzIiwgCiAgImJhc2FsIGNlbGwgb2YgZXBpZGVybWlzIiwgCiAgImtlcmF0aW5vY3l0ZSIsCiAgImJhc2FsIGNlbGwgb2YgZXBpZGVybWlzIiwKICAia2VyYXRpbm9jeXRlIiwKICAiYmFzYWwgY2VsbCBvZiBlcGlkZXJtaXMiLAogICJrZXJhdGlub2N5dGUiCikKCmNlbGxfb250b2xvZ3lfaWQgPC0gYygKICAiQ0w6MDAwMjE4NyIsCiAgIkNMOjAwMDIxODciLCAKICAiQ0w6MDAwMjE4NyIsCiAgIkNMOjAwMDAzMTIiLAogICJDTDowMDAyMTg3IiwKICAiQ0w6MDAwMDMxMiIsCiAgIkNMOjAwMDIxODciLAogICJDTDowMDAwMzEyIgopCgp0aXNzQG1ldGEuZGF0YVssJ2ZyZWVfYW5ub3RhdGlvbiddIDwtIHBseXI6Om1hcHZhbHVlcyh4ID0gdGlzc0BpZGVudCwgZnJvbSA9IGNsdXN0ZXIuaWRzLCB0byA9IGZyZWVfYW5ub3RhdGlvbikKdGlzc0BtZXRhLmRhdGFbLCdjZWxsX29udG9sb2d5X2NsYXNzJ10gPC0gcGx5cjo6bWFwdmFsdWVzKHggPSB0aXNzQGlkZW50LCBmcm9tID0gY2x1c3Rlci5pZHMsIHRvID0gY2VsbF9vbnRvbG9neV9jbGFzcykKdGlzc0BtZXRhLmRhdGFbLCdjZWxsX29udG9sb2d5X2lkJ10gPC0gcGx5cjo6bWFwdmFsdWVzKHggPSB0aXNzQGlkZW50LCBmcm9tID0gY2x1c3Rlci5pZHMsIHRvID0gY2VsbF9vbnRvbG9neV9pZCkKClRTTkVQbG90KG9iamVjdCA9IHRpc3MsIGRvLmxhYmVsID0gVFJVRSwgcHQuc2l6ZSA9IDAuNSwgZ3JvdXAuYnk9J2NlbGxfb250b2xvZ3lfY2xhc3MnKQoKYGBgCgojIyBTdXBwbGVtZW50YXJ5IEZpZ3VyZXMgCgpGaWcuIHN1cHBUb25ndWUxLiB0U05FIGJhc2VkIG9uIGZyZWUgYW5ub3RhdGlvbgoKRmlnLiBzdXBwVG9uZ3VlMi4gRXhwcmVzc2lvbiBvZiBnZW5lcyB1c2VkIGZvciBhbm5vdGF0aW9uIG9mIHRoZSBjbHVzdGVycy4gRmVhdHVyZSBwbG90IGZyb20gYm90aCBwbGF0Zm9ybXMgb246IFRvcDJhLCBDZGMyMCwgTWtpNjcsIEtydDE1LCBLcnQ1LCBLcnQxNCwgU2JzbiwgS3J0MTAsIEtydDQsIEtydDEzLCBLcnQzNiwgS3J0ODQsIEhveGMxMwoKRmlnLiBzdXBwVG9uZ3VlMy4gIEV4cHJlc3Npb24gb2YgZ2VuZXMga25vd24gdG8gYmUgZXhwcmVzc2VkIGluIHRhc3RlIHJlY2VwdG9yIGNlbGxzLiAgVmlvbGluIHBsb3QgZnJvbSBib3RoIHBsYXRmb3JtcyBvbjogS3J0OCwgVGFzMXIxLCBUYXMxcjIsIFRhczFyMywgTmNhbTEsIENhcjQKCgojIyBDaGVja2luZyBmb3IgYmF0Y2ggZWZmZWN0cwoKCkNvbG9yIGJ5IG1ldGFkYXRhLCBsaWtlIHBsYXRlIGJhcmNvZGUsIHRvIGNoZWNrIGZvciBiYXRjaCBlZmZlY3RzLgpgYGB7cn0KVFNORVBsb3Qob2JqZWN0ID0gdGlzcywgZG8ucmV0dXJuID0gVFJVRSwgZ3JvdXAuYnkgPSAibW91c2Uuc2V4IikKYGBgCgpQcmludCBhIHRhYmxlIHNob3dpbmcgdGhlIGNvdW50IG9mIGNlbGxzIGluIGVhY2ggaWRlbnRpdHkgY2F0ZWdvcnkgZnJvbSBlYWNoIHBsYXRlLgoKYGBge3J9CnRhYmxlKGFzLmNoYXJhY3Rlcih0aXNzQGlkZW50KSwgYXMuY2hhcmFjdGVyKHRpc3NAbWV0YS5kYXRhJHBsYXRlLmJhcmNvZGUpKQpgYGAKCgoKIyBTYXZlIHRoZSBSb2JqZWN0IGZvciBsYXRlcgpXaGVuIHlvdSBzYXZlIHRoZSBhbm5vdGF0ZWQgdGlzc3VlLCBwbGVhc2UgZ2l2ZSBpdCBhIG5hbWUuCgpgYGB7cn0KZmlsZW5hbWUgPSBoZXJlKCcwMF9kYXRhX2luZ2VzdCcsICcwNF90aXNzdWVfcm9ial9nZW5lcmF0ZWQnLCAKICAgICAgICAgICAgICAgICAgICAgcGFzdGUwKCJmYWNzIiwgdGlzc3VlX29mX2ludGVyZXN0LCAiX3NldXJhdF90aXNzLlJvYmoiKSkKcHJpbnQoZmlsZW5hbWUpCnNhdmUodGlzcywgZmlsZT1maWxlbmFtZSkKYGBgCgpgYGB7cn0KIyBUbyByZWxvYWQgYSBzYXZlZCBvYmplY3QKZmlsZW5hbWUgPSBoZXJlKCcwMF9kYXRhX2luZ2VzdCcsICcwNF90aXNzdWVfcm9ial9nZW5lcmF0ZWQnLCAKICAgICAgICAgICAgICAgICAgICAgIHBhc3RlMCgiZmFjcyIsIHRpc3N1ZV9vZl9pbnRlcmVzdCwgIl9zZXVyYXRfdGlzcy5Sb2JqIikpCmxvYWQoZmlsZT1maWxlbmFtZSkKYGBgCgoKCiMgRXhwb3J0IHRoZSBmaW5hbCBtZXRhZGF0YQoKU28gdGhhdCBCaW9odWIgY2FuIGVhc2lseSBjb21iaW5lIGFsbCB5b3VyIGNlbGxfb250b2xvZ3lfY2xhc3NzLCBwbGVhc2UgZXhwb3J0IHRoZW0gYXMgYSBzaW1wbGUgY3N2LgoKYGBge3J9CmhlYWQodGlzc0BtZXRhLmRhdGEpCmBgYAoKCmBgYHtyfQpmaWxlbmFtZSA9IGhlcmUoJzAwX2RhdGFfaW5nZXN0JywgJzAzX3Rpc3N1ZV9hbm5vdGF0aW9uX2NzdicsIAogICAgICAgICAgcGFzdGUwKHRpc3N1ZV9vZl9pbnRlcmVzdCwgIl9mYWNzX2NlbGxfb250b2xvZ3lfY2xhc3MuY3N2IikpCndyaXRlLmNzdihGZXRjaERhdGEodGlzcywgYygncGxhdGUuYmFyY29kZScsJ2NlbGxfb250b2xvZ3lfY2xhc3MnLCdjZWxsX29udG9sb2d5X2lkJywgJ2ZyZWVfYW5ub3RhdGlvbicsICd0U05FXzEnLCAndFNORV8yJykpLCBmaWxlPWZpbGVuYW1lKQoKYGBgCgoK